Display device and method of operating the same

ABSTRACT

A wearable electronic device including a wireless communication unit configured to be wirelessly connected to a projector for projecting a stored presentation onto a screen of an external device; a main body configured to be worn by a user; a microphone integrally connected to the main body; a sensing unit configured to detect a bio state of the user wearing the electronic device; a display unit configured to be attached to the main body; and a controller configured to match a voice information input through the microphone with a portion of the stored presentation, and to display a part of the stored presentation that follows the portion of the stored presentation matching the voice information input on the display unit, wherein the controller is further configured to change an output size of the part of the stored presentation that follows the portion of the stored presentation when the bio state indicates the user to be in a tense state.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a Continuation of co-pending application Ser. No.14/186,176, filed on Feb. 21, 2014, which claims priority under 35U.S.C. § 119(a) to Application No. 10-2013-0106742, filed in Republic ofKorea on Sep. 5, 2013, all of which are hereby expressly incorporated byreference into the present application.

BACKGROUND OF THE INVENTION

1. Field of the Invention

The present invention relates to a display device and a method ofoperating the display device and particularly to a display deviceconnected to a projector for proceeding with a presentation andconfigured to be mountable on a specific portion of a body and a methodof operating the display device.

2. Background of the Invention

A projector projects image information transferred from a predetermineddisplay device onto a screen in order to proceed with a presentation andshows images to attendants. A display for transmitting image informationto the projector is broadly categorized by mobility into amobile/portable terminal and a stationary terminal. The mobile terminalis further categorized by portability into a handheld terminal and avehicle-mounted terminal.

In response to an increasing demand for diversified functions, theterminal is formed as a multimedia player with multiple functions suchas shooting a photographic object as a still image or moving images,reproducing digital audio and video compression files, playing a game,receiving a broadcast or the like. Furthermore, structural and softwaremodifications to the multimedia player are considered for supporting andimproving functions of the display device.

In addition, a presenter of the presentation proceeds with thepresentation using the images projected onto the screen and the likethrough the projector connected to the display device. However,occasionally, the presentation does not proceed smoothly only with theimages projected onto the screen.

For example, the presenter should provide an explanation while ensuringa planned progress in the presentation and at the same time measuringconcentration of the attendants and understandability of thepresentation to the attendants. However, if the presenter proceeds withthe presentation while grasping various situations and types ofinformation in this manner, occasionally, he/she finds his/herexplanation insufficient, is time-pressed, omits the importantexplanation or is at a loss for explanation.

In addition, if the presenter asks a question relating to theexplanation during the presentation in progress, occasionally he/sheshould remember the question for a long time or find the time tooinsufficient for effectively answering the question.

Accordingly, there is an increasing need for providing the presenterwith a way to help him/her smoothly proceed with the presentationentailing the explanation. An example of this is a display devicecapable of being mounted on the head of the wearer.

An example of such a display device is smart glasses. Further, afunction executable on an existing mobile terminal is convenientlyexecuted also on the smart glasses, which is an example of a wearabledevice mounted on a specific portion of the body. However, there aredisadvantages in that the smart glasses are small in size, andinformation is transferable to the wearer, that is, the presenter of thepresentation is limited.

Particularly, because the presenter has to provide an explanationwithout any interruption, the information has to be provided topresenter in a manner not to prevent the explanation from beinginterrupted.

SUMMARY OF THE INVENTION

Therefore, an aspect of the detailed description is to provide a displaydevice mountable on the body of a presenter of a presentation, such asthe head, which provides content information to be next presented andtime information in accordance with details that the presenter currentlypresents and with a speed at which the presenter makes the presentation,and a method of operating the display device.

Another aspect of the detailed description is to provide a displaydevice mountable on the body of a presenter of a presentation, such asthe head, which provides related information so as to smoothly proceedwith the presentation although an event happens unexpectedly, such aswhen the presenter is in a tense state or when the presenter forgetsdetails of the presentation, and a method of operating the displaydevice.

Still another of the detailed description is to provide a display deviceconfigured to provide a presenter with information relating to apresentation, transferred from an external apparatus, or to generatefeedback on the information and provide the feedback, and a method ofoperating the display device.

To achieve these and other advantages and in accordance with the purposeof this specification, as embodied and broadly described herein, thereis provided an output device configured to be connected to a projectorfor proceeding with a presentation and thus to output contentinformation relating to an image to be projected onto a screen, theoutput device including a main body configured to be mountable on aspecific portion of a body, a microphone integrally connected to themain body, and a controller that matches voice information, inputthrough the microphone, and already-stored content details associatedwith the presentation and outputs at least a portion of the contentdetails that follow a portion of the content details, which is matchedto the voice information by a reference value or above.

In the output device, the output unit may be a bone conduction presenterintegrally connected to the main body and the controller may convert thefollowing content details into a voice signal, transfer the voice signalto the bone conduction presenter, and adjust an output speed of thevoice signal so that the output speed corresponds to an input speed ofthe voice information.

To achieve these and other advantages and in accordance with the purposeof this specification, as embodied and broadly described herein, thereis provided a display device configured to be connected to a projectorfor proceeding with a presentation and thus to output contentinformation relating to an image to be projected onto a screen, thedisplay device including a main body configured to be mountable on aspecific portion of a body, a microphone integrally connected to themain body, a controller that matches voice information, input throughthe microphone, and already-stored content details associated with thepresentation and detects the content information that follows a portionof the content details, which is matched to the voice information by areference value or above, and a display connected to the main body, isarranged in a position corresponding to at least one among wearer's botheyes, and thus is configured to display at least a portion of thedetected following content information.

In the display device, the controller may adjust an output speed of thefollowing content information displayed on the display, so that theoutput speed of the following content information corresponds to aninput speed of the voice information, and additional informationrelating to the following content information may be displayed on thedisplay, based on the output speed. In the display device, theadditional information may include at least one among information on awearer of the main body, time information calculated based on the inputspeed of the voice information and a remaining amount of content,information on an amount of the already-stored content, informationindicating the extent to which the presentation proceeds, additionalinformation relating to the following content information, andinformation on attendants of the presentation.

In the display device, the already-assigned content may include multiplepages and the controller may determine an output range of the followingcontent information to be displayed on the display, based on timeinformation already assigned to each of the multiple pages and oninformation on a remaining amount of presentation time.

The display device may further a sensing unit for detecting living bodyinformation (a bio-signal) on a wearer, which is integrally connected tothe main body, in which the controller may monitor a state of thewearer, based on the detected living body information, and when thewearer is determined to be is a tense state, perform control so that anoutput size of the following content information is changed or ahighlighting effect is output.

In display device, a touch sensor that detects a touch input may beprovided in at least a region of the main body, in which a first camerafor detecting a gesture input by a wearer may be included in the outsidesurface of the main body, and the controller may perform control so thata display change occurs in the display, based on the gesture input bythe wearer recognized by at least one among the touch sensor and thefirst camera.

In the display device, in response to the gesture input in which thewearer shakes his/her hand positioned between the main body and thescreen when the main body and the screen face each other, the controllermay perform control so that an image output to the display is projectedonto the screen connected to the projector.

In the display device, the controller may magnify the following contentinformation displayed on the display in a navigating manner, in responseto the gesture input that rotates multiple touch starting points thatare applied to a border region of the display, in a first direction.

In the display device, the controller may reduce the following contentinformation displayed on the display in a navigating manner, in responseto the gesture input that rotates multiple touch starting points thatare applied to a border region of the display, in a second direction.

In the display device, when an input that drags a touch applied to aregion of the main body in a first direction is applied, the controllermay scroll through lines of the following content information displayedon the display in a first direction and when an input that drags thetouch applied to the region of the main body in a second direction, thecontroller may scroll through the lines of the following contentinformation displayed on the display in a second direction.

In the display device, based on a touch input that taps on a firstregion of the main body a predetermined number of time, the controllermay turn over a document page corresponding to the following contentinformation in a first direction, and based on a touch input that tapson a second region of the main body the predetermined number of time,the controller may turn over the document page corresponding to thefollowing content information in a second direction.

The display device further includes a second camera for tracking awearer's stare, which is connected to the inside of the main body, inwhich when the wearer's stare is fixed to a specific object output tothe display, the controller may perform control so that a result of anadditional search associated with a specific object is displayed on aregion of the display.

In the display device, in response to the wearer's stare being fixed tothe screen for a predetermined time when an input of the voiceinformation is not applied, the controller may output a highlightingeffect to a script of the following content information displayed on thedisplay, or convert the following content information into a voicesignal and outputs the voice signal.

In the display device, the controller may control the display so that adisplay change corresponding to a predetermined voice command inputthrough the microphone occurs.

In the display device, when the voice information input through themicrophone remains unmatched to the already-stored content details for apredetermined time, the controller may perform control so that apredetermined alarm is output.

In the display device, the predetermined alarm may include at least oneor more among a sound message, a vibration, and a highlighting effectfor the following content information.

The display device may further include a first display and a seconddisplay that correspond to the wearer's left and right eyes,respectively, in which the controller may perform control so that visualinformation corresponding to the voice information input through themicrophone is output to any one of the first display and the seconddisplay and additional information relating to the following contentinformation or a result of an additional search is output to the other.

The display device may further include a wireless communication unitthat receives a wireless signal corresponding to information relating tothe presentation, which is connected to an external apparatus, in whichthe controller may convert the wireless signal into characters, anddisplays the characters on a region of the display or store thecharacters in a document file format in which the characters aretransmittable to the outside.

In the display device, the wireless communication unit may be configuredso that at least an item of data is transmittable to the connectedexternal apparatus, and the controller may search the already-storedcontent details using the characters as key words and control thedisplay so that data corresponding to a result of the search isdisplayed on the display or control the wireless communication unit sothat the data corresponding to the result of the search is t transmittedby the wireless communication unit.

The display device may further include a wireless communication unit forprocessing with wireless communication with the projector, in which whenthe gesture input set for transmitting the already-stored contentassociated with the presentation to the project, is detected, thecontroller may control the project so that a screen displayed on thedisplay is output to the screen at the same time.

To achieve these and other advantages and in accordance with the purposeof this specification, as embodied and broadly described herein, thereis provided a method of operating a display device configured to beconnected to a projector for proceeding with a presentation and thus tooutput content information relating to an image to be projected onto ascreen, the method including matching voice information, input throughthe microphone connected to a main body, and already-stored contentdetails associated with the presentation, detecting the contentinformation that follows a portion of the content details, which ismatched to the voice information by a reference value or above,displaying at least a portion of details corresponding to a position ofthe following content information on a display arranged so as tocorrespond to at least one among both eyes of a wearer of the main body;and adjusting an output speed of the following content informationdisplayed on the display so that the output speed of the followingcontent information corresponds to an input speed of the voiceinformation.

Further scope of applicability of the present application will becomemore apparent from the detailed description given hereinafter. However,it should be understood that the detailed description and specificexamples, while indicating preferred embodiments of the invention, aregiven by way of illustration only, since various changes andmodifications within the spirit and scope of the invention will becomeapparent to those skilled in the art from the detailed description.

BRIEF DESCRIPTION OF THE DRAWINGS

The accompanying drawings, which are included to provide a furtherunderstanding of the invention and are incorporated in and constitute apart of this specification, illustrate exemplary embodiments andtogether with the description serve to explain the principles of theinvention.

In the drawings:

FIG. 1 is a block diagram illustrating an example of a display deviceaccording to an embodiment of the present invention;

FIGS. 2A and 2B are diagrams illustrating a telecommunication system inwhich the display device according to the embodiment of the presentinvention can operate;

FIG. 3 is a diagram illustrating an example of the display deviceconfigured to be mounted on a specific portion of a body according tothe embodiment of the present invention;

FIG. 4 is a diagram illustrating the display device according to theembodiment of the present invention and a system connected to thedisplay device to proceed with a presentation;

FIG. 5 is a flowchart illustrating a method of operating the displaydevice according to the embodiment of the present invention;

FIGS. 6A to 6C are diagrams illustrating the flowchart in FIG. 5;

FIGS. 7A to 7H are diagrams illustrating examples in which a screenoutput to the display device, or an image projected onto the displaydevice is controlled based on various movements of a wearer according tothe embodiment of the present invention;

FIGS. 8A to 8B are diagrams illustrating examples in which the screenoutput to the display device is controlled based on a wearer's stareaccording to the embodiment of the present invention;

FIGS. 9A to 9B are diagrams illustrating examples in which the screenoutput to the display device is controlled based on a voice command fromthe wearer according to the embodiment of the present invention;

FIGS. 10A to 10C are diagrams illustrating an example in which thedisplay device according to the embodiment of the present invention isconnected to an external apparatus to receive a question and conducts asearch for the purpose of preparing for an answer to the question; and

FIG. 11 is a diagram illustrating the fact that the display deviceaccording to the embodiment of the present invention providesinformation relating to the presentation to the wearer and at the sametime, provides video information to be projected, to a projector.

DETAILED DESCRIPTION OF THE INVENTION

Description will now be given in detail of the exemplary embodiments,with reference to the accompanying drawings. For the sake of briefdescription with reference to the drawings, the same or equivalentcomponents will be provided with the same reference numbers, anddescription thereof will not be repeated. A suffix “module” or “unit”used for constituent elements disclosed in the following description ismerely intended for easy description of the specification, and thesuffix itself does not give any special meaning or function. Indescribing the present invention, if a detailed explanation for arelated known function or construction is considered to unnecessarilydivert the gist of the present invention, such explanation has beenomitted but would be understood by those skilled in the art. Theaccompanying drawings are used to help easily understood the technicalidea of the present invention and it should be understood that the ideaof the present invention is not limited by the accompanying drawings.

FIG. 1 is a block diagram of a display device 100 in accordance with oneexemplary embodiment. The display device 100 may comprise components,such as a wireless communication unit 110, an Audio/Video (AN) inputunit 120, a user input unit 130, a sensing unit 140, an output unit 150,a memory 160, an interface unit 170, a controller 180, a power supply190 and the like. FIG. 1 shows the display device 100 having variouscomponents, but it is understood that implementing all of theillustrated components is not a requirement. Greater or fewer componentsmay alternatively be implemented.

The wireless communication unit 110 may typically include one or moremodules which permit wireless communications between the display device100 and a wireless communication system or between the display device100 and a network within which the display device 100 is located. Forexample, the wireless communication unit 110 may include at least one ofa broadcast receiving module 111, a mobile communication module 112, awireless Internet module 113, a short-range communication module 114, alocation information module 115 and the like.

The broadcast receiving module 111 receives a broadcast signal and/orbroadcast associated information from an external broadcast managingentity via a broadcast channel. The broadcast channel may include asatellite channel and a terrestrial channel. The broadcast managingentity may indicate a server which generates and transmits a broadcastsignal and/or broadcast associated information or a server whichreceives a pre-generated broadcast signal and/or broadcast associatedinformation and sends them to the display device. The broadcast signalmay be implemented as a TV broadcast signal, a radio broadcast signal,and a data broadcast signal, among others. The broadcast signal mayfurther include a data broadcast signal combined with a TV or radiobroadcast signal.

Examples of broadcast associated information may include informationassociated with a broadcast channel, a broadcast program, a broadcastservice provider, and the like. The broadcast associated information maybe provided via a mobile communication network, and received by themobile communication module 112.

The broadcast associated information may be implemented in variousformats. For instance, broadcast associated information may includeElectronic Program Guide (EPG) of Digital Multimedia Broadcasting (DMB),Electronic Service Guide (ESG) of Digital Video Broadcast-Handheld(DVB-H), and the like.

The broadcast receiving module 111 may be configured to receive digitalbroadcast signals transmitted from various types of broadcast systems.Such broadcast systems may include Digital MultimediaBroadcasting-Terrestrial (DMB-T), Digital MultimediaBroadcasting-Satellite (DMB-S), Media Forward Link Only (MediaFLO),Digital Video Broadcast-Handheld (DVB-H), Integrated Services DigitalBroadcast-Terrestrial (ISDB-T) and the like. The broadcast receivingmodule 111 may be configured to be suitable for every broadcast systemtransmitting broadcast signals as well as the digital broadcastingsystems.

Broadcast signals and/or broadcast associated information received viathe broadcast receiving module 111 may be stored in a suitable device,such as a memory 160.

The mobile communication module 112 transmits/receives wireless signalsto/from at least one of network entities (e.g., base station, anexternal display device , a server, etc.) on a mobile communicationnetwork. Here, the wireless signals may include audio call signal, video(telephony) call signal, or various formats of data according totransmission/reception of text/multimedia messages.

The mobile communication module 112 may implement a video call mode anda voice call mode. The video call mode indicates a state of calling withwatching a callee's image. The voice call mode indicates a state ofcalling without watching the callee's image. The wireless communicationmodule 112 may transmit and receive at least one of voice and image inorder to implement the video call mode and the voice call mode.

The wireless Internet module 113 supports wireless Internet access forthe display device. This module may be internally or externally coupledto the display device 100. Examples of such wireless Internet access mayinclude Wireless LAN (WLAN) (Wi-Fi), Wireless Broadband (Wibro),Worldwide Interoperability for Microwave Access (Wimax), High SpeedDownlink Packet Access (HSDPA) and the like.

The short-range communication module 114 denotes a module forshort-range communications. Suitable technologies for implementing thismodule may include BLUETOOTH™, Radio Frequency IDentification (RFID),Infrared Data Association (IrDA), Ultra-WideBand (UWB), ZigBee™, NearField Communication (NFC) and the like.

The location information module 115 denotes a module for detecting orcalculating a position of a display device. An example of the locationinformation module 115 may include a Global Position System (GPS)module.

Still referring to FIG. 1, the A/V input unit 120 is configured toprovide audio or video signal input to the display device. The A/V inputunit 120 may include a camera 121 and a microphone 122. The camera 121receives and processes image frames of still pictures or video obtainedby image sensors in a video call mode or a capturing mode. The processedimage frames may be displayed on a display 151.

The image frames processed by the camera 121 may be stored in the memory160 or transmitted to the exterior via the wireless communication unit110. Also, user's position information and the like may be calculatedfrom the image frames acquired by the camera 121. Two or more cameras121 may be provided according to the configuration of the displaydevice.

The microphone 122 may receive an external audio signal while thedisplay device is in a particular mode, such as a phone call mode, arecording mode, a voice recognition mode, or the like. This audio signalis processed into digital data. The processed digital data is convertedfor output into a format transmittable to a mobile communication basestation via the mobile communication module 112 for the phone call mode.The microphone 122 may include assorted noise removing algorithms toremove noise generated in the course of receiving the external audiosignal.

The user input unit 130 may generate input data input by a user tocontrol the operation of the display device. The user input unit 130 mayinclude a keypad, a dome switch, a touchpad (e.g., staticpressure/capacitance), a jog wheel, a jog switch and the like.

The sensing unit 140 provides status measurements of various aspects ofthe display device. For instance, the sensing unit 140 may detect anopen/close status of the display device, a change in a location of thedisplay device 100, a presence or absence of user contact with thedisplay device 100, the location of the display device 100,acceleration/deceleration of the display device 100, and the like, so asto generate a sensing signal for controlling the operation of thedisplay device 100.

For example, regarding a slide-type display device, the sensing unit 140may sense whether a sliding portion of the display device is open orclosed. Other examples include sensing functions, such as the sensingunit 140 sensing the presence or absence of power provided by the powersupply 190, the presence or absence of a coupling or other connectionbetween the interface unit 170 and an external device.

The output unit 150 is configured to output an audio signal, a videosignal or a tactile signal. The output unit 150 may include a display151, an audio output module 153, an alarm unit 154 and a haptic module155.

The display 151 may output information processed in the display device100. For example, when the display device is operating in a phone callmode, the display 151 will provide a User Interface (UI) or a GraphicUser Interface (GUI), which includes information associated with thecall. As another example, if the display device is in a video call modeor a capturing mode, the display 151 may additionally or alternativelydisplay images captured and/or received, UI, or GUI.

The display 151 may be implemented using, for example, at least one of aLiquid Crystal Display (LCD), a Thin Film Transistor-Liquid CrystalDisplay (TFT-LCD), an Organic Light-Emitting Diode (OLED), a flexibledisplay, a three-dimensional (3D) display, an e-ink display or the like.

Some of such displays 151 may be implemented as a transparent type or anoptical transparent type through which the exterior is visible, which isreferred to as ‘transparent display’. A representative example of thetransparent display may include a Transparent OLED (TOLED), and thelike. The rear surface of the display 151 may also be implemented to beoptically transparent. Under this configuration, a user can view anobject positioned at a rear side of a terminal body through a regionoccupied by the display 151 of the terminal body.

The display 151 may be implemented in two or more in number according toa configured aspect of the display device 100. For instance, a pluralityof the displays 151 may be arranged on one surface to be spaced apartfrom or integrated with each other, or may be arranged on differentsurfaces.

The display 151 may also be implemented as a stereoscopic display unit152 for displaying stereoscopic images. Here, the stereoscopic image maybe a three-dimensional (3D) stereoscopic image, and the 3D stereoscopicimage is an image refers to an image making a viewer feel that a gradualdepth and reality of an object on a monitor or a screen is the same as areality space. A 3D stereoscopic image is implemented by using binoculardisparity. Binocular disparity refers to disparity made by the positionsof two eyes. When two eyes view different 2D images, the images aretransferred to the brain through the retina and combined in the brain toprovide the perception of depth and reality sense.

The stereoscopic display unit 152 may employ a stereoscopic displayscheme such as stereoscopic scheme (a glass scheme), anauto-stereoscopic scheme (glassless scheme), a projection scheme(holographic scheme), or the like. Stereoscopic schemes commonly usedfor home television receivers, or the like, include Wheatstonestereoscopic scheme, or the like.

The auto-stereoscopic scheme includes, for example, a parallax barrierscheme, a lenticular scheme, an integral imaging scheme, or the like.The projection scheme includes a reflective holographic scheme, atransmissive holographic scheme, or the like.

In general, a 3D stereoscopic image is comprised of a left image (a lefteye image) and a right image (a right eye image). According to how leftand right images are combined into a 3D stereoscopic image, the 3Dstereoscopic imaging method is divided into a top-down method in whichleft and right images are disposed up and down in a frame, an L-to-R(left-to-right, side by side) method in which left and right images aredisposed left and right in a frame, a checker board method in whichfragments of left and right images are disposed in a tile form, aninterlaced method in which left and right images are alternatelydisposed by columns and rows, and a time sequential (or frame by frame)method in which left and right images are alternately displayed by time.

Also, as for a 3D thumbnail image, a left image thumbnail and a rightimage thumbnail are generated from a left image and a right image of theoriginal image frame, respectively, and then combined to generate asingle 3D thumbnail image. In general, thumbnail refers to a reducedimage or a reduced still image. The thusly generated left imagethumbnail and the right image thumbnail are displayed with a horizontaldistance difference therebetween by a depth corresponding to thedisparity between the left image and the right image on the screen,providing a stereoscopic space sense.

As illustrated, a left image and a right image required for implementinga 3D stereoscopic image is displayed on the stereoscopic display unit152 by a stereoscopic processing unit (not shown). The stereoscopicprocessing unit may receive the 3D image and extract the left image andthe right image, or may receive the 2D image and change it into a leftimage and a right image.

Here, if the display 151 and a touch sensitive sensor (referred to as atouch sensor) have a layered structure therebetween (referred to as a‘touch screen’), the display 151 may be used as an input device as wellas an output device. The touch sensor may be implemented as a touchfilm, a touch sheet, a touchpad, and the like.

The touch sensor may be configured to convert changes of a pressureapplied to a specific part of the display 151, or a capacitanceoccurring from a specific part of the display 151, into electric inputsignals. Also, the touch sensor may be configured to sense not only atouched position and a touched area, but also touch pressure. Here, atouch object is an object to apply a touch input onto the touch sensor.Examples of the touch object may include a finger, a touch pen, a styluspen, a pointer or the like.

When touch inputs are sensed by the touch sensors, corresponding signalsare transmitted to a touch controller. The touch controller processesthe received signals, and then transmits corresponding data to thecontroller 180. Accordingly, the controller 180 may sense which regionof the display 151 has been touched.

Still referring to FIG. 1, a proximity sensor 141 may be arranged at aninner region of the display device 100 covered by the touch screen, ornear the touch screen. The proximity sensor 141 may be provided as oneexample of the sensing unit 140. The proximity sensor 141 indicates asensor to sense presence or absence of an object approaching to asurface to be sensed, or an object disposed near a surface to be sensed,by using an electromagnetic field or infrared rays without a mechanicalcontact. The proximity sensor 141 has a longer lifespan and a moreenhanced utility than a contact sensor.

The proximity sensor 141 may include a transmissive type photoelectricsensor, a direct reflective type photoelectric sensor, a mirrorreflective type photoelectric sensor, a high-frequency oscillationproximity sensor, a capacitance type proximity sensor, a magnetic typeproximity sensor, an infrared rays proximity sensor, and so on. When thetouch screen is implemented as a capacitance type, proximity of apointer to the touch screen is sensed by changes of an electromagneticfield. In this instance, the touch screen (touch sensor) may becategorized into a proximity sensor.

Hereinafter, for the sake of brief explanation, a status that thepointer is positioned to be proximate onto the touch screen withoutcontact will be referred to as ‘proximity touch’, whereas a status thatthe pointer substantially comes in contact with the touch screen will bereferred to as ‘contact touch’. For the position corresponding to theproximity touch of the pointer on the touch screen, such positioncorresponds to a position where the pointer faces perpendicular to thetouch screen upon the proximity touch of the pointer.

The proximity sensor 141 senses proximity touch, and proximity touchpatterns (e.g., distance, direction, speed, time, position, movingstatus, etc.). Information relating to the sensed proximity touch andthe sensed proximity touch patterns may be output onto the touch screen.

When a touch sensor is overlaid on the stereoscopic display unit 152 ina layered manner (hereinafter, referred to as ‘stereoscopic touchscreen’), or when the stereoscopic display unit 152 and a 3D sensorsensing a touch operation are combined, the stereoscopic display unit152 may also be used as a 3D input device.

As examples of the 3D sensor, the sensing unit 140 may include aproximity sensor 141, a stereoscopic touch sensing unit 142, anultrasonic sensing unit 143, and a camera sensing unit 144.

The proximity sensor 141 detects the distance between a sensing object(e.g., the user's finger or a stylus pen) applying a touch by using theforce of electromagnetism or infrared rays without a mechanical contactand a detect surface. By using the distance, the terminal recognizeswhich portion of a stereoscopic image has been touched. In particular,when the touch screen is an electrostatic touch screen, the degree ofproximity of the sensing object is detected based on a change of anelectric field according to proximity of the sensing object, and a touchto the 3D image is recognized by using the degree of proximity.

The stereoscopic touch sensing unit 142 is configured to detect thestrength or duration of a touch applied to the touch screen. Forexample, the stereoscopic touch sensing unit 142 may sense touchpressure. When the pressure is strong, it may recognize the touch as atouch with respect to an object located farther away from the touchscreen toward the inside of the terminal.

The ultrasonic sensing unit 143 is configured to recognize positioninformation of the sensing object by using ultrasonic waves. Theultrasonic sensing unit 143 may include, for example, an optical sensorand a plurality of ultrasonic sensors. The optical sensor is configuredto sense light and the ultrasonic sensors may be configured to senseultrasonic waves. Since light is much faster than ultrasonic waves, atime for which the light reaches the optical sensor is much shorter thana time for which the ultrasonic wave reaches the ultrasonic sensor.Therefore, a position of a wave generation source may be calculated byusing a time difference from the time that the ultrasonic wave reachesbased on the light as a reference signal.

The camera sensing unit 144 includes at least one of a camera 121, aphoto sensor, and a laser sensor. For example, the camera 121 and thelaser sensor may be combined to detect a touch of the sensing objectwith respect to a 3D stereoscopic image. When distance informationdetected by a laser sensor is added to a 2D image captured by thecamera, 3D information can be obtained.

In another example, a photo sensor may be laminated on the displaydevice. The photo sensor is configured to scan a movement of the sensingobject in proximity to the touch screen. In detail, the photo sensorincludes photo diodes and transistors at rows and columns to scancontent mounted on the photo sensor by using an electrical signalchanging according to the quantity of applied light. Namely, the photosensor calculates the coordinates of the sensing object according tovariation of light to thus obtain position information of the sensingobject.

The audio output module 153 may convert and output as sound audio datareceived from the wireless communication unit 110 or stored in thememory 160 in a call signal reception mode, a call mode, a record mode,a voice recognition mode, a broadcast reception mode, and the like.Also, the audio output module 153 may provide audible outputs related toa particular function performed by the display device 100 (e.g., a callsignal reception sound, a message reception sound, etc.). The audiooutput module 153 may include a speaker, a buzzer or the like.

The alarm unit 154 outputs a signal for informing about an occurrence ofan event of the display device 100. Events generated in the displaydevice may include call signal reception, message reception, key signalinputs, a touch input etc. In addition to video or audio signals, thealarm unit 154 may output signals in a different manner, for example,using vibration to inform about an occurrence of an event. The video oraudio signals may be also outputted via the audio output module 153, sothe display 151 and the audio output module 153 may be classified asparts of the alarm unit 154.

A haptic module 155 generates various tactile effects the user may feel.A typical example of the tactile effects generated by the haptic module155 is vibration. The strength and pattern of the haptic module 155 canbe controlled. For example, different vibrations may be combined to beoutputted or sequentially outputted.

Besides vibration, the haptic module 155 may generate various othertactile effects such as an effect by stimulation such as a pinarrangement vertically moving with respect to a contact skin, a sprayforce or suction force of air through a jet orifice or a suctionopening, a contact on the skin, a contact of an electrode, electrostaticforce, etc., an effect by reproducing the sense of cold and warmth usingan element that can absorb or generate heat.

The haptic module 155 may be implemented to allow the user to feel atactile effect through a muscle sensation such as fingers or arm of theuser, as well as transferring the tactile effect through a directcontact. Two or more haptic modules 155 may be provided according to theconfiguration of the display device 100.

The memory 160 may store software programs used for the processing andcontrolling operations performed by the controller 180, or maytemporarily store data (e.g., a phonebook, messages, still images,video, etc.) that are inputted or outputted. In addition, the memory 160may store data regarding various patterns of vibrations and audiosignals outputted when a touch is inputted to the touch screen.

The memory 160 may include at least one type of storage medium includinga Flash memory, a hard disk, a multimedia card micro type, a card-typememory (e.g., SD or DX memory, etc.), a Random Access Memory (RAM), aStatic Random Access Memory (SRAM), a Read-Only Memory (ROM), anElectrically Erasable Programmable Read-Only Memory (EEPROM), aProgrammable Read-Only memory (PROM), a magnetic memory, a magneticdisk, and an optical disk. Also, the display device 100 may be operatedin relation to a web storage device that performs the storage functionof the memory 160 over the Internet.

The interface unit 170 serves as an interface with every external deviceconnected with the display device 100. For example, the external devicesmay transmit data to an external device, receives and transmits power toeach element of the display device 100, or transmits internal data ofthe display device 100 to an external device. For example, the interfaceunit 170 may include wired or wireless headset ports, external powersupply ports, wired or wireless data ports, memory card ports, ports forconnecting a device having an identification module, audio input/output(I/O) ports, video I/O ports, earphone ports, or the like.

The identification module may be a chip that stores various informationfor authenticating the authority of using the display device 100 and mayinclude a user identity module (UIM), a subscriber identity module (SIM)a universal subscriber identity module (USIM), and the like. Inaddition, the device having the identification module (referred to as‘identifying device’, hereinafter) may take the form of a smart card.Accordingly, the identifying device may be connected with the terminal100 via the interface unit 170.

When the display device 100 is connected with an external cradle, theinterface unit 170 may serve as a passage to allow power from the cradleto be supplied therethrough to the display device 100 or may serve as apassage to allow various command signals inputted by the user from thecradle to be transferred to the display device therethrough. Variouscommand signals or power inputted from the cradle may operate as signalsfor recognizing that the display device is properly mounted on thecradle.

The controller 180 typically controls the general operations of thedisplay device. For example, the controller 180 performs controlling andprocessing associated with voice calls, data communications, videocalls, and the like. The controller 180 may include a multimedia module181 for reproducing multimedia data. The multimedia module 181 may beconfigured within the controller 180 or may be configured to beseparated from the controller 180.

The controller 180 may perform a pattern recognition processing torecognize a handwriting input or a picture drawing input performed onthe touch screen as characters or images, respectively.

Also, the controller 180 may execute a lock state to restrict a userfrom inputting control commands for applications when a state of thedisplay device meets a preset condition. Also, the controller 180 maycontrol a lock screen displayed in the lock state based on a touch inputsensed on the display 151 in the lock state of the display device.

The power supply unit 190 receives external power or internal power andsupplies appropriate power required for operating respective elementsand components under the control of the controller 180.

Various embodiments described herein may be implemented in acomputer-readable or its similar medium using, for example, software,hardware, or any combination thereof.

For hardware implementation, the embodiments described herein may beimplemented by using at least one of application specific integratedcircuits (ASICs), digital signal processors (DSPs), digital signalprocessing devices (DSPDs), programmable logic devices (PLDs), fieldprogrammable gate arrays (FPGAs), processors, controllers,micro-controllers, microprocessors, electronic units designed to performthe functions described herein. In some cases, such embodiments may beimplemented by the controller 180 itself

For software implementation, the embodiments such as procedures orfunctions described herein may be implemented by separate softwaremodules. Each software module may perform one or more functions oroperations described herein. Software codes can be implemented by asoftware application written in any suitable programming language. Thesoftware codes may be stored in the memory 160 and executed by thecontroller 180.

Hereinafter, a communication system which is operable with the displaydevice 100 according to an embodiment of the present invention will bedescribed.

FIGS. 2A and 2B are conceptual views of a communication system operablewith a display device 100 in accordance with the present invention.

First, referring to FIG. 2A, such communication systems utilizedifferent air interfaces and/or physical layers. Examples of such airinterfaces utilized by the communication systems include FrequencyDivision Multiple Access (FDMA), Time Division Multiple Access (TDMA),Code Division Multiple Access (CDMA), and Universal MobileTelecommunications System (UMTS), the Long Term Evolution (LTE) of theUMTS, the Global System for Mobile Communications (GSM), and the like.

By way of non-limiting example only, further description will relate toa CDMA communication system, but such teachings apply equally to othersystem types including the CDMA wireless communication system. Referringnow to FIG. 2A, a CDMA wireless communication system is shown having aplurality of display device s 100, a plurality of base stations (BSs)270, base station controllers (BSCs) 275, and a mobile switching center(MSC) 280.

The MSC 280 is configured to interface with a conventional Public SwitchTelephone Network (PSTN) 290. The MSC 280 is also configured tointerface with the BSCs 275. The BSCs 275 are coupled to the basestations 270 via backhaul lines. The backhaul lines may be configured inaccordance with any of several known interfaces including, for example,E1/T1, ATM, IP, PPP, Frame Relay, HDSL, ADSL, or xDSL. Hence, theplurality of BSCs 275 can be included in the system as shown in FIG. 2A.

Each base station 270 may include one or more sectors, each sectorhaving an omni-directional antenna or an antenna pointed in a particulardirection radially away from the base station 270. Alternatively, eachsector may include two or more different antennas. Each base station 270may be configured to support a plurality of frequency assignments, witheach frequency assignment having a particular spectrum (e.g., 1.25 MHz,5 MHz, etc.).

The intersection of sector and frequency assignment may be referred toas a CDMA channel. The base stations 270 may also be referred to as BaseStation Transceiver Subsystems (BTSs). In some cases, the term “basestation” may be used to refer collectively to a BSC 275, and one or morebase stations 270. The base stations may also be denoted as “cellsites.” Alternatively, individual sectors of a given base station 270may be referred to as cell sites.

A broadcasting transmitter (BT) 295, as shown in FIG. 2A, transmits abroadcast signal to the display device s 100 operating within thesystem. The broadcast receiving module 111 (FIG. 1B) is typicallyconfigured inside the display device 100 to receive broadcast signalstransmitted by the BT 295.

FIG. 2A further depicts several Global Positioning System (GPS)satellites 300. Such satellites 300 facilitate locating the position ofat least one of plural display device s 100. Two satellites are depictedin FIG. 2, but it is understood that useful position information may beobtained with greater or fewer satellites than two satellites. The GPSmodule 115 (FIG. 1B) is typically configured to cooperate with thesatellites 300 to obtain desired position information. It is to beappreciated that other types of position detection technology, (i.e.,location technology that may be used in addition to or instead of GPSlocation technology) may alternatively be implemented. If desired, atleast one of the GPS satellites 300 may alternatively or additionally beconfigured to provide satellite DMB transmissions.

During typical operation of the wireless communication system, the basestations 270 receive sets of reverse-link signals from various displaydevice s 100. The display devices 100 are engaging in calls, messaging,and executing other communications. Each reverse-link signal received bya given base station 270 is processed within that base station 270. Theresulting data is forwarded to an associated BSC 275. The BSC 275provides call resource allocation and mobility management functionalityincluding the orchestration of soft handoffs between base stations 270.The BSCs 275 also route the received data to the MSC 280, which thenprovides additional routing services for interfacing with the PSTN 290.Similarly, the PSTN 290 interfaces with the MSC 280, and the MSC 280interfaces with the BSCs 275, which in turn control the base stations270 to transmit sets of forward-link signals to the display device s100.

Hereinafter, description will be given of a method for acquiringlocation information of a display device using a wireless fidelity(WiFi) positioning system (WPS), with reference to FIG. 2B.

The WiFi positioning system (WPS) 300 refers to a location determinationtechnology based on a wireless local area network (WLAN) using WiFi as atechnology for tracking the location of the display device 100 using aWiFi module provided in the display device 100 and a wireless accesspoint 320 for transmitting and receiving to and from the WiFi module.

The WiFi positioning system 300 may include a WiFi locationdetermination server 310, a display device 100, a wireless access point(AP) 320 connected to the display device 100, and a database 330 storedwith any wireless AP information.

The WiFi location determination server 310 extracts the information ofthe wireless AP 320 connected to the display device 100 based on alocation information request message (or signal) of the display device100. The information of the wireless AP 320 may be transmitted to theWiFi location determination server 310 through the display device 100 ortransmitted to the WiFi location determination server 310 from thewireless AP 320.

The information of the wireless AP extracted based on the locationinformation request message of the display device 100 may be at leastone of MAC address, SSID, RSSI, channel information, privacy, networktype, signal strength and noise strength.

The Wi-Fi location determination server 310 receives the information ofthe wireless AP 320 connected to the display device 100 as describedabove, and compares the received wireless AP 320 information withinformation contained in the pre-established database 330 to extract (oranalyze) the location information of the display device 100.

In addition, referring to FIG. 2B, as an example, the wireless APconnected to the display device 100 is illustrated as a first, a second,and a third wireless AP 320. However, the number of wireless APsconnected to the display device 100 may be changed in various waysaccording to a wireless communication environment in which the displaydevice 100 is located. When the display device 100 is connected to atleast one of wireless APs, the WiFi positioning system 300 can track thelocation of the display device 100.

Next, considering the database 330 stored with any wireless APinformation in more detail, various information of any wireless APsdisposed at different locations may be stored in the database 330.

The information of any wireless APs stored in the database 330 may beinformation such as MAC address, SSID, RSSI, channel information,privacy, network type, latitude and longitude coordinate, building atwhich the wireless AP is located, floor number, detailed indoor locationinformation (GPS coordinate available), AP owner's address, phonenumber, and the like.

In this manner, any wireless AP information and location informationcorresponding to the any wireless AP are stored together in the database330, and thus the WiFi location determination server 310 may retrievewireless AP information corresponding to the information of the wirelessAP 320 connected to the display device 100 from the database 330 toextract the location information matched to the searched wireless AP,thereby extracting the location information of the display device 100.

Furthermore, the extracted location information of the display device100 may be transmitted to the display device 100 through the WiFilocation determination server 310, thereby acquiring the locationinformation of the display device 100.

Next, FIG. 3 is a diagram illustrating a configuration in which thedisplay device 100 according to one embodiment of the present inventiondescribed referring to FIG. 1 is mountable on a body's specific portion.Referring to FIG. 3, the display device 100 includes a main body frame101, the microphone 122, an output unit (the alarm unit 153 and/or thedisplay 151) and the controller 180.

The display device 100 according to an embodiment of the presentinvention is realized as a head-mounted display (HMD) device. As aspecific example, the display device 100 according to an embodiment ofthe present invention is realized as smart glasses.

In addition, the display device 100 according to the embodiment of thepresent invention is configured to be mountable on a specific portion ofthe body, such as a head, a wrist, a neck, and an ear, or on top ofclothing. In addition, the touch sensor that detects a wearer's touchinput is arranged at least on one point, or one region of the main bodyframe 101.

If the display 151 is provided to the display device 100 according to anembodiment of the present invention, visual information relating to apresentation is in the 2D or 3D form. In this instance, the display 151is combined with the main body 100 so that the display 151 is arrangedin a position corresponding to at least one among the wearer's left andright eyes and outputs the visual information relating to thepresentation.

Further, from the conceptual point of view, the visual informationrelating to the presentation is content associated with the presentationto proceed, which is already stored in the main body 100, or is datareceived from an external apparatus, or is all objects that aregenerated according to a wearer's input. For example, the visualinformation relating to the presentation includes a text file forpresentation, inquiry data relating to the presentation received fromthe external apparatus and the like.

In addition, the display device 100 according to an embodiment of thepresent invention may be an output device without a display. In thisinstance, outputting of the information relating to the presentation isperformed through a presenter (specifically, a bone conductionpresenter).

The microphone 122, connected to the main body 100, receives voice of awearer who makes a presentation. In addition, the controller 180 matchesvoice information input in real time through the microphone 122, tocontent details associated with the already-stored presentation. If aportion of the content details matched to the voice information by areference value or above is detected, the controller 180 outputs contentdetails that follow the matched portion, that is, at least a portion ofdetails that the wearer next presents, to the display 151 or the speaker153.

Further, the controller 180 adjusts an output speed of the followingcontent details that are output to the display 151 or the presenter 153,according to an input speed of the voice information input in real timeinto the microphone 122. For example, if a script of the details thatthe wearer successively presents, are output line by line, the fasterthe wearer makes a presentation, the faster the script lines output tothe display 151 are scrolled. Conversely, the slower the wearer makes apresentation, the more slowly the script lines output to the display 151are scrolled. Alternatively, when the wearer makes a presentationslowly, the script lines remain in a stationary state.

Next, referring to FIG. 4, the display device according to theembodiment of the present invention, and a system, connected to thedisplay device, for making a presentation are described. As illustratedin FIG. 4, the display device 100 according to the embodiment of thepresent invention is connected to a projector 50 for projecting an imageonto a screen 80. In addition, the display device 100 may be connectedto another display device that provides the projector 50 with videoinformation, for example, a mobile terminal 70.

Here, an example of another display device 80 wirelessly connected tothe display device 100 according to the embodiment of the presentinvention is a mobile phone, a smart phone, a laptop computer, apersonal digital assistant (PDA), a portable multimedia player (PMP), anavigator, a digital TV set, or a desktop computer. Alternatively, thedisplay device 80 may be the same as the display device 100 according tothe embodiment of the present invention. The other display devices 70described above are collectively referred to as the “externalapparatus.”

The external apparatus 70, connected to the projector 50, provides thevideo information to be projected onto the screen 80. In addition, theexternal apparatus 70 communicates with the display device 100 toreceive the video information to be projected onto the screen 80. Inaddition, the external apparatus 70 communicates with the display device100 to transmit data relating to the presentation to the display device100.

Screen information and/or sound information that are output to thedisplay device 100, as described above, are the content transmitted fromthe external apparatus 70, are the content already stored in a displaydevice 200, or are data generated based on that content.

In addition, the display device 100 performs related operations, basedon a wearer's gesture input, a wearer's voice command, or living bodyinformation on the wearer, or based on a control command received fromthe external apparatus 70. For example, the display device 100 displaysa screen change that corresponds to a user's input or output a screenand/or sound that corresponds to the control command received from theexternal apparatus 70.

In addition, the projector 50 receives video information to be projectedonto the screen 80 from the display device 100 according to theembodiment of the present invention or the external apparatus 70.

In the former case, the display device 100 plays a role of providing thewearer with the information relating to the presentation and at the sametime plays a role of transmitting the information relating to thepresentation to the projector 50. Further, the information provided tothe wearer and the information provided to the projector 50 may bedifferent information scope. For example, a larger amount of informationis provided to the wearer who makes a presentation and a minimum amountof information for explanation is provided to the projector 50 thatprovides the video information to the screen.

Thus, when receiving the video information, the projector 50signal-processes received R, G, B image signals in a manner that makesthem suitable for an actual image form and realizes the result of signalprocessing as the actual image form, such as a laser or an LCD.Thereafter, the project 50 projects the actual image form enlargedlyonto the screen 70.

In addition, a wireless or cable connection is made between the displaydevice 100 and the external apparatus 70 and between an externalapparatus 170 and the projector 50, for example, using a short-rangecommunication standard, a wireless Internet standard such as Wi-Fi, oran external-apparatus interface standard such as a universal serial bus(USB).

In addition, if the connection is made between the display device 100and the external apparatus 70, the display device 100 outputs the screeninformation, the same as the image to be projected onto the screen 80through the projector 50, or outputs the screen information includingthe information more detailed than the screen-projected image. To do so,the display device 100 receives the data relating to the correspondingscreen information from the external apparatus 70.

Further, the display device 100 operates detects a wearer's gesturethrough the camera provided in the main body, tracks a wearer's stare toexecute a corresponding operation, or operates so that the correspondingscreen information is transmitted to the external apparatus 70 forprojecting onto the screen through the projector 50.

In addition, the display device 100 controls transmits the correspondingscreen information directly to the projector 50 and thus control theimage to be projected onto the screen 80. In this instance, the wearerof the display device 100 can control both the screen information outputto the display device 100 and the screen information projected onto thescreen 80, at the same time through a predetermined gesture input.

A method of operating the display device 100 for helping thepresentation proceed is described below referring FIG. 5 and FIGS. 6A to6C. In particular, FIG. 5 is a flowchart illustrating the method ofoperating the display device according to one embodiment of the presentinvention, and FIGS. 6A to 6C are diagrams illustrating the flowchart inFIG. 5.

Here, the display device 100, connected to the projector 50 capable ofperforming the presentation, outputs content information relating to theimage projected onto the screen 80 (FIG. 4). In addition, the displaydevice 100 is configured to be mounted on a body's specific portion.Here, as an example of the display device 100, the head-mounted display(HMD) is described for the purpose of description. However, the presentinvention is not limited to this example, embodiments according to anembodiment of the present invention are realized as a type of displaydevice without a display, a type of display device in which an AR isapplied and the screen is output to the display, or a type of displaydevice in which is mountable on different portions of the body (forexample, a wrist, a neck, an ear, or a shoulder) or on top of clothing.

In addition, the content associated with the presentation is in advancestored in the display device 100. Along with this content, additionalinformation may be further stored, such as the time and date forpresentation, a place for presentation, and the number of attendants. Inaddition, detailed information relating to tag setting for a specificobject for the content associated with the presentation, linking to thespecific object, and the like are in advance stored.

Further, if the content associated with the presentation is made frommultiple pages, an importance level is assigned to each page orpresentation time is in advance assigned to each page, and then theassigned importance level and presentation time are stored. In addition,it is preferable that the information is stored in advance before thepresentation proceeds, but if necessary, it is possible for the externalapparatus (a server) to provide the information while the presentationis in progress, and update of the information also is possible after thepresentation is finished.

First, the display device 100 according to the embodiment of the presentinvention is mounted on the specific portion of the body of the wearerwho makes a presentation. Accordingly, the display device 100 detects amounted state and a mounted position and outputs an alarm correspondingto the mounting on the specific portion of the body.

In addition, when the projector 50, configured to project the imageinformation relating to the presentation onto the screen 80, is turnedon, the display device 100 automatically recognizes this and isconnected to the projector 50, through the wearer's input orautomatically.

When the controller 180 detects that the display device 100 is worn andconnected to the projector 50 in an ON state (S501), the display device100 outputs the corresponding alarm and thus the wearer can recognizestarting of the presentation (S502). When the presentation begins (Yesin S502), the controller 180 of the display device 100 matches voiceinformation on the wearer (or presenter of the presentation) inputthrough the microphone 122 to the content details associated withalready stored content in the display device 100 (S503).

Specifically, the controller 180 performs speech-to-text (STT)converting on the voice information input and then compares between theresult of STT converting and characters in the content associated withthe already-stored presentation to obtain the extent to which they areconsistent with each other. Further, the controller 180 first determineswhether the voice information input through the microphone 122 isconsistent with the already-stored wearer's voice information. When theyare determined not to be consistent with each other, the controller 180does not perform the matching process.

According to one embodiment, the content associated with thealready-stored presentation may be content that the wearer stores inadvance in the display device 100 before the presentation begins. Inaddition, according to another embodiment, the content associated withthe already-stored presentation may be content downloaded or streamedfrom the external apparatus 70 or the external server by being connectedto the external apparatus 70 or the external server.

Further, as the presentation begins, the controller 180 operates a timerwithin it. The timer may operate so that a predetermined time set forthe presentation decreases to “0” as time goes by. As a result of thematching in Step S503, if it is detected that the extent to which thecontent associated with the already-stored presentation is matched tothe wearer's voice information input through the microphone 122 is at areference value or above, the controller 180 detects the information ona portion of the content that follows a position in which a matchedportion of the content is detected (S504).

Here, the reference value is a predetermined ratio value or a ratiovalue changed through the user input. For example, a specific portion ofthe content associated with the already-stored presentation is matchedto the wearer's voice information by 90 percent or more, thecorresponding position in which the matching is detected is determinedto be the matched portion of the content.

In addition, if the already-stored content is made from multiple linesor multiple pages, the controller 180 pre-determines a reference atwhich the matching begins. For example, the controller 180 determines astarting line of matching or a starting page of matching. The controller180 determines that a page of the content corresponding to the imageinformation projected onto the screen 80 is the starting page ofmatching. To do this, the display device 100 described in the presentinvention includes at least a camera 121 to obtain the image projectedonto the screen 80.

In addition, the controller 180 adjusts the extent to which thefollowing content information is detected, according to the input speedof the voice information input through the microphone 122. Further, thecontroller 180 detects only a pointer value corresponding to a positionof the following content information and thus provides only thecorresponding positional information to the wearer. In this instance, awaiting state is maintained until the user's input for outputting isapplied.

In this manner, when detecting the following content information, thecontroller 180 displays at least a portion of the details correspondingto the following content information detected, to the display 151(S505). Here, the details corresponding to the following contentinformation refer to details that the wearer next presents according tothe presentation order, that is, content details that are stored afterthe portion of the content associated with the already-storedpresentation, which is matched to the wearer's voice information.

For example, the details corresponding to the following contentinformation may be a script of the details of what to tell next or maybe a page that follows the image currently displayed on the screen 80.In this manner, the content details ahead of the details of thepresentation currently in progress is in advance provided to thepresenter. This helps the presenter be prepared for what to tell next.As a result, the presentation proceeds smoothly.

Here, the display 151 is configured to be arranged so as to correspondto at least one among both eyes of the wearer of the main body. That is,the display 151 is arranged to correspond to the wearer's left eye orright eye, or to the wearer's both eyes.

In addition, the controller 180 outputs not only the following contentinformation detected, but also the content information being presentedand is present immediately before, to the display 151. In this instance,the controller 180 displays the content information corresponding to thevoice information input through the microphone 122 and the followingcontent information so as to visually distinguish between them.

For example, the scripts of the content associated with thepresentation, which have primary colors, are output to the display 151.As the wearer proceeds with the presentation, an effect (hereinafterreferred to as a “NORAEBANG subtitle effect”) is output in which thescripts change in different colors (or in different shapes). To do this,the controller 180 updates the screen output to the display 151 and thescreen change, in real time.

In addition, a method of displaying the details corresponding to thefollowing content information to the display 151 is realized or modifiedin various ways. As one example, a content screen output to the display151 may be of a type in which the content screen is viewable only to thewearer.

For example, the content screen may be of a type in which an augmentedreality screen is displayed for the wearer. The augmented reality screenis realized so that the projector and a prism are connected to eachother at a position adjacent to the camera 121 as illustrated in FIG. 3and thus the visual information is transferred to the projector, then istransferred from the projector to the prism, and is spread from theprism directly to the wearer's eyeballs. In addition, the content screenmay be of a type in which the visual information provided by thecontroller 180 is displayed only within the display 151 arranged in amanner that corresponds to at least one among the wearer's both eyes,resulting in the screen being displayed for the wearer.

As another example, the content screen output to the display 151 may beof a type in which the content screen is displayed for all viewersthrough the screen 80 or other objects (for example, a wall or a desk).To do this, in addition to the display 151, the display device 100 inFIG. 3 further includes a projection unit configured to include a lightsource element, an image formation module, and a lens. One or moreprojection units are provided in a position adjacent to the display 151.

Here, the light source element is an element that emits light. The imageformation module is configured to form the video information (or thescreen information) using light. The projection unit includes,particularly, a laser diode, as the light source element. The laserdiode is made from, for example, a red laser diode.

In this instance, the controller 180 outputs the visual informationcurrently output to the display 151, to the screen 80 and another objectat the same time, using light (for example, visible light) emitted fromthe projection unit . Therefore, a disadvantage of a glasses-typedisplay device 100, in which the display 151 is limited in size, asillustrated in FIG. 3, is overcome.

In addition, there is an advantage that a larger amount of the visualinformation than an amount of the video information projected onto thescreen 80 can be provided to the attendants of the presentation. Thereis another advantage that the visual information is greater in varietythan the video information projected onto the screen 80 can be providedto the attendants of the presentation.

As another example, the display 151 according to an embodiment of thepresent invention the display device 100 may be of a type in which thedisplay 151 is not included and the screen information is not providedto the wearer as described above. In such a case, the details of thefollowing content information detected by the controller 180 are outputthrough the audio output module 152 integrally combined with the displaydevice 100.

In addition, the controller 180 further outputs additional informationrelating to the following content information to the display 151, basedon the output speed of the content information. Here, the additionalinformation includes at least one among information on the wearer of themain body, time information calculated based on the input speed of thevoice information and a remaining amount of content, information on anamount of the already-stored content, information indicating the extentto which the presentation proceeds, additional information relating tothe following content information and information on the attendants ofthe presentation.

If the display 151 includes a first display and a second display thatcorrespond to the wearer's left and right eyes, respectively, thecontroller 180 outputs the visual information (for example, the scriptsof the content) corresponding to information on the wearer's voice toany one of the first display and the second display, and outputs theadditional information relating to the following content information ora result of an additional search to the other.

For example, if the multiple display units 151 are provided so as tocorrespond to the wearer's left and right eyes, respectively, asillustrated in FIG. 6A, a script 611 being presented and scripts 613 ofthe content to be presented are output to a first display 610 in avisually differentiated manner (for example, the “NORAEBANG subtitleeffect”). For example, when the wearer says “AAA,” the NORAEBANGsubtitle effect is output on the script “AAA” displayed on the display151.

A control key 612 for scrolling through the scripts of the content isdisplayed on one region of the first display 610. Further, when aproximity touch by the wearer is applied to the control key 612, thescripts that are output to the first display 610 are scrolled through.

In addition, an image 622 the same as the image projected onto thescreen 80 or the same in presentation progress as the image projectedonto the screen 80 is output to a second display 620 in FIG. 6A.Additional information, such as a thumbnail image 623 indicating aposition of the corresponding image 622 in the whole content or anindicator 625 indicating the extent of progress, is displayed on thesecond display 620 in FIG. 6A.

Further, the wearer moves the indicator 625 to a desired position inorder to display a desired page on the display 151. In addition, animage 621 indicating the time information that depends on progress inthe presentation is displayed on one region of the second display 620.The image 621 includes the information on the time (for example, 4minutes and 30 seconds) assigned to the corresponding page and theinformation on the time (for example, 15 seconds) that elapsescurrently.

As another example, referring to FIG. 6B, a script 631 being presentedand scripts 632 of the content to be presented are output to the firstdisplay 610 in a visually differentiated manner (for example, theNORAEBANG effect), and the scripts are automatically scrolled throughaccording to the information on the wearer's voice input through themicrophone 122 or is scrolled through along a direction of the wearer'sstare recognized through the camera 121.

Then, the image 630, which is the same as the image projected onto thescreen 80, or the same in presentation progress as the image projectedonto the screen 80 is output to the second display 620, so as to have amultiple page-overlapping structure in which the image 630 appears inthe front. The screen output in this manner is changed by control keys640 displayed on one region of the second display 620.

Each of the multiple pages has the positional information and theassigned time information. Specifically, when the wearer applies theproximity touch to the control key indicating “next,” as illustrated inFIG. 6B, a “page turning effect” is output and at the same time a pagethat follows the image 622 is displayed.

As another example, referring to FIG. 6C, the script 631 being presentedand the scripts 632 of the content to be presented are output to thefirst display 610, in a visually differentiated manner (for example, theNORAEBANG subtitle effect), and the results of the additional searchassociated with the script 631 being presented are displayed on thesecond display 620.

To do this, the wearer performs the proximity touch on an “additionalkey 645” displayed on the second display 620. Then, a web search result655 associated with a script keyword 661 currently being presented isdisplayed on the second display 620. If the number of the web searchresult is two or more, different keys 662 a and 662 b for executing apage turning function are output.

In addition, if the display 151 is one, the following contentinformation and the additional information described above are displayedon the multiple regions, respectively, is displayed when the screen ischanged according to a user operation, or is displayed in the form of apop-up window, depending on presentation environment.

Further, if a tone of the wearer's voice input through the microphone122 exceeds a reference range, that is, if the wearer's voice is in anexcessively high or low tone, an indicator indicating a current tone ofthe wearer's voice is displayed on the display 151. For example, if thetone of the wearer's voice is higher than the reference range, thecontroller 180 outputs a red-colored arrow indicating the upwarddirection to the display 151 in order for the wearer to recognizehis/her current voice tone, or the controller 180 outputs an arrowindicating the downward direction to the display 151 in order to providethe wearer with a guide for lowering his/her voice tone.

Conversely, if the tone of the wearer's voice is lower than thereference range, the controller 180 outputs a blue-colored arrowindicating the downward direction to the display 151 in order for thewearer to recognize his/her current voice tone, the controller 180outputs an arrow indicating the upward direction to the display 151 inorder to provide the wearer with a guide for making a presentation withhis/her further raised voice tone.

In addition, if a presentation speed of the wearer that results from thevoice input through the microphone 122 exceeds the reference value (thatis, excessively fast) or is determined to exceed the time alreadyassigned to the presentation (that is, excessively slow), the displaydevice 100 displays an indicator corresponding to the currentpresentation speed (or a proper-speed guide indicator) on the display151 in order to provide the wearer with a guide for speaking at a properspeed.

In addition, various example of the operation associated with differentdetails that are output to the display 151, an output range, a userinterface (UI), and a screen change are described in detail below. Inthis manner, the following content information is output to the display151 (or the audio output module 153), the controller 180 adjusts theoutput speed of the content information so that the output speed of thecontent information corresponds to the input speed of the information onthe wearer's voice input into the microphone 122 (S506).

Further, when the display device 100 described in the present inventionis configured not to include the display 151, as described above, andthus not to provide the screen information to the wearer, the controller180 converts the detected following content details into a voice signal,transfers the result of conversion to the audio output module 153, forexample, the bone conduction presenter), and adjusts an output speed ofthe voice signal so that the output speed of the voice signalcorresponds to the input speed of the voice information. For example,the controller 180 performs the control so that as the input speed ofthe voice information is faster, the output speed of the followingcontent details that are output through the bone conduction presenter isfaster.

The matching processing, the detection processing, and the outputtingprocessing of the voice information, which are described above, repeatuntil the presentation is finished (S507). Further, when the connectedprojector 50 is changed to an off state, or when a predetermined user'sinput is applied to the display device 100, the controller 180recognizes this as a termination of the presentation.

In addition, when the termination of the presentation is recognized inStep S507, the controller 180 outputs a predetermined alarm (forexample, an alarm sound, a vibration, a guide message) that correspondsto the termination of the presentation.

As described above, the display device according to the embodiment ofthe present embodiments is mounted on the head of the presenter thatmake a presentation. Thus, the display device provides the relatedinformation in advance in order for the presenter to smoothly proceedwith the presentation, and operates in accordance with the presentationspeed of the presenter without performing a special operation. Thisprovides the presenter with convenience.

Examples are described below in each of which according to variousinputs applied to the display device 100 described in the presentinvention, the screen and/or the sound that are output to the displaydevice 100 are controlled or the image projected onto the screen 80 iscontrolled.

[x] FIGS. 7A to 7H are diagrams illustrating examples in which thescreen output to the display device, or the image projected onto thedisplay device is controlled based on various signals input by thewearer, according to the embodiment of the present invention.

Here, as an example, the display device 100 includes the display 151 andthe content associated with the already-stored presentation is made fromthe multiple pages. In addition, each of the following contentinformation and the additional information (for example, the positionalinformation on the content, the time information, the information on theadditional result, and so forth) output to the display 151 is assumed toinclude an amount of the information larger than an amount of the imageprojected onto the screen 80.

In addition, the controller 180 determines an output range of thefollowing content information to be displayed on the display 151, basedon the time information already assigned to each of the multiple pagesand on the information on a remaining amount of presentation time.

For example, when the time assigned to the corresponding page is almostconsumed, the display 151 outputs the following page in advance. Inaddition, if the time assigned to the presentation is almost consumed,considering that the progress speed of the presentation becomes fasterand faster, the display 151 outputs an amount of the contentinformation, larger than a reference range, to the display 151.

Further, when the time already assigned to the corresponding page islonger compared to different pages, recognizing that the correspondingpage contains an important explanation, the controller 151 outputs alarger amount of the content information to the display 151. Conversely,if the time already assigned to the corresponding page is shortercompared to the different pages, considering a likelihood that thecorresponding page will be skipped because it is of less importance, thecontroller 151 outputs the following page in advance to the display 151.In this instance, the wearer gives an explanation, referring to only theimage in the screen 80.

In addition, as illustrated in FIG. 3, in order to detect the varioussignals that are input by the wearer, the display device 100 includes atleast one or more among the sensing unit 140 for detecting the livingbody information (a bio-signal), a first camera 121 for detecting thewearer's gesture, a second camera for tracking the wearer's stare, and atouch sensor provided in one point or one region of the frame 101 thatmaintains a form of the display device 100.

According to one embodiment, the controller 180 determines whether ornot the wearer who makes a presentation is in a tense state, based onthe living body information (bio-signal) of the wearer detected throughthe sensing unit 140. This determination is made by the externalapparatus 70 connected to the display device 100.

Here, the bio-signal means an electric signal between human cells, forexample, one among an electroencephalogram (EEG) signal, anelectrocardiogram (ECG) signal, a photoplethymogram (PPG) signal, and agalvanic skin response (GSR) signal, but is not limited to these. Thebio-signal includes various types of information that are widely usedfor measuring an emotional state in the related art, for example, a bodytemperature, a change in a staring direction, a change in the size of apupil, the number of times of blinking and so forth.

When a pulse rate, or a breath rate detected through the sensing unit140 is recognized as being increased, and/or when the body temperatureis recognized as being increased to a reference value or above, thecontroller 180 determines that the wearer is in the tense state.

In addition, in order to determine whether the wearer is in the tense,the controller 180 sets the living body information, detected throughthe sensing unit 140, to be a first determination reference, and setsdifferent detection information, such as a voice tone or a voicetrembling of the wearer, or the number of times that the wearer swallowshis/her saliva, to be a second determination reference.

When in this manner, the wearer is determined to be in the tense state,the controller 180 outputs changes the sizes of character size or thesize of an image that corresponds to the following content informationoutput to the display 151, or outputs a highlighting effect.

Specifically, if the wearer is determined to be in the tense state whenthe following content details are output to the display 151 asillustrated in FIG. 7A, the sizes of characters 720 “Project A” arechanged and thus are output as boldfaced characters 720″ to help thewearer easily recognize the script that he/she should read for thepresentation. Along with this, the highlighting effect of causingblinking is output to the characters 720″ to draw attention of thewearer. In addition, the controller 180 outputs the characters 720 to benext presented, to the audio output module 153, for example, the boneconduction presenter.

In addition, this process may be performed in phases according to theextent to which the wearer is tense. In addition, along with this, thecontroller 180 outputs the content screen or the sound alreadyregistered with the image display device 100 in order alleviate thetense state of wearer. Further, according to one embodiment, thecontroller 180 performs the control so that a display change occurs inthe following content information output to the display 151, based onthe gesture input by the wearer.

To do this, in the display device 100, the touch sensor that detects thetouch input is provided in at least a region of the main body frame, andthe first camera 121 for detecting the gesture input by the wearer isprovided in the outside surface of the main body. That is, the firstcamera 121 is used for detecting the gesture input by the wearer.

From the conceptual point of view, the gesture input conceptuallyincludes an input that uses a motion gesture, such as movements of thewearer's hand, an adjacent object, and the like, an input that usesrecognition of the shape or size of the hand or the adjacent object, andan input that uses a hand gesture, such as a specific movement of thehand.

Referring to FIGS. 7B to 7H, specific examples are described below ineach of which the video information output to the display 151 or thescreen 80 with various gesture inputs by the wearer is controlled usingthe first camera 121 and the touch sensor.

According to a first embodiment, as illustrated in FIG. 7B, when thegesture input is applied in which the wearer shakes or waves his/herhand 701 of the wearer positioned between the main body and the screen apredetermined number of times when the display device 100 and the screen80 on which to project the image of presentation faces each other, inresponse to this, the controller 180 performs the control so that animage 720 currently projected onto the display 151 is projected onto thescreen 80 as well.

Further, when a sound corresponding to the image projected onto thescreen 80 is output, this sound also is changed to a sound thatcorresponds to the image output to the display 151. In this manner, thecase where the image output to the screen 80 and the image output to thedisplay 151 are of the same is limited to only if the gesture inputdescribed above is applied.

As time goes by, a different image (that is, the following contentinformation and the additional information) from the image output to thescreen 80 is output back to the display 151. In addition, when apredetermined control signal is transmitted to the projector 50connected to the display device 100, the screen output to the screen 80returns to the previous screen.

According to a second embodiment, as illustrated in FIGS. 7C and 7D,when the gesture input that rotates multiple touch starting pointsapplied to a border region of the display 151 is applied in apredetermined direction, the controller 180 magnifies or reduces thefollowing content information displayed in the display 151 in anavigating manner.

Specifically, referring to FIG. 7C, when the multiple touch startingpoints (for example, an operation in which the wearer grasps the frameof the display with his/her thumb or forefinger (and the other fingers))applied to the border region (for example, the frame) of the display 151are rotated in a first direction, for example, clockwise, the controller180 magnifies the following content information displayed on the display151 in a navigating manner.

Accordingly, a screen 735 of which the size is increased with the centerof a previous screen 730 as the center of the screen 735 is output tothe display 151. In this instance, the wearer applies the proximitytouch to the previous screen 730 or the size-increased screen 735, andthus a different portion of the screen is moved or rotated to bepositioned in the center. In addition, the size-enlarged screen 735includes further detailed information according to a type of the content(for example, a map).

Specifically, referring to FIG. 7D, when the multiple touch startingpoints (for example, the operation in which the wearer grasps the frameof the display with his/her thumb or forefinger (and the other fingers))applied to the border region (for example, the frame) of the display 151are rotated in a second direction, for example, counterclockwise, thecontroller 180 reduces the following content information displayed onthe display 151 in a navigating manner.

Accordingly, the screen 735 of which the size is reduced with the centerof the previous screen 730 as the center of the screen 735 is output tothe display 151. In this instance, the size-reduced screen 735 issmaller in size than the previous screen, but the output range of thecontent is further broadened.

In addition, according to a third embodiment, referring to FIG. 7E, whenan input that drags a touch applied to one region of the frame 101 ofthe display device 100 in the first direction, for example, in an inwarddirection C that faces toward the wearer is applied, the controller 180scrolls through script lines of the following content informationdisplayed on the display 151 in the first direction, that is, so thatthe script lines are displayed.

Further, referring to FIG. 7F, when an input that drags a touch appliedto one region of the frame 101 of the display device 100 in the seconddirection, for example, in an outward direction D opposite to the inwarddirection C, is applied, the controller 180 scrolls through the scriptlines of the following content information in the second direction, thatis, so that the previous script lines are displayed.

In addition, according to a fourth embodiment, referring to FIG. 7G,based on the touch input that taps on a first region (for example, aright-side region) of the frame 101 of the display device 100 apredetermined number of times (for example, two times), the controller180 turns over a document page corresponding to the following contentinformation display on the display 151 in the first direction (forexample, in the direction of the following page).

Further, referring to FIG. 7H, based on the touch input that taps on asecond region (for example, a left-side region) of the frame 101 of thedisplay device 100 a predetermined number of times (for example, twotimes), the controller 180 turns over the document page corresponding tothe following content information displayed on the display 151 in thesecond direction (for example, in the direction of the previous page).

In addition, according to a fifth embodiment, when the touch input thattaps on the first region or the second region of the frame 101 of thedisplay device 100 three times or more, or when a long touch input isperformed on the first region or the second region, the turning-over ofthe page accelerates. That is, an effect of turning over the multiplepages is output in the direction corresponding to the correspondingregion. When a short touch input is applied in this state, the pagestops being turned over and the page at a stopping point is output tothe display 151.

Referring to FIGS. 8A and 8B, examples are described below in each ofwhich the screen output to the display device is controlled based on thewearer's stare. To do this, the display device 100 may further includethe second camera for tracking the wearer's stare, which is connected tothe inside of the main body. The second camera moves or rotatescorresponding to a movement of the eyeball of the wearer.

That is, the second camera is used to track the wearer's stare. Eyetracking refers to a technology in which the wearer's stare is trackedby recognizing the pupil of the wearer from the image input through thecamera. The eye tracking has an application in sports broadcasting, asystem for the disabled, recognition of a customer's traffic line andrecognition of a customer's stare. In recent years, research has beenconducted on various algorithms for interfaces for the eye tracking.

When the wearer's stare is fixed to a specific object, which is outputto the display 151, for a predetermined time when the following contentinformation is output to the display 151, the controller 180 outputs theresult of the additional search associated with the specific object toone region of the display 151.

For example, if the wearer of the display device 100, as illustrated inFIG. 8A, stares at an “A” object 801 output to the display 151, for twoseconds, web search results 810 and 820 associated with the “A” object801 are displayed on different regions of the display 151. In addition,the wearer of the display device 100 is recognized as staring at aspecific object output to the screen 80, the web search resultassociated with the corresponding object is output.

Further, if the input by the wearer of the voice information into themicrophone 122 is not applied and the wearer's stare is fixed to thescreen for a predetermined time when the following content informationis output to the display 151, the controller 180 recognizes that thewearer forgets what to present next, or that the wearer is in the tensestate.

In this instance, the controller 180 performs the control so that thehighlighting effect is output on the script of the following contentinformation output to the display 151 or that the following contentinformation is converted into the voice signal and thus is output. Forexample, when a wearer 900, as illustrated in FIG. 8B, stares at thescreen 80 for a predetermined time (for example, five seconds or more)without saying any words during the presentation in progress, thehighlighting effect (for example, blinking, color changing, box markingand the like) is output on some of the scripts that are read in thescreen output to the display 151 of the display device 100.

Then, along with this, an icon 840 for outputting the contentinformation to be next presented, as a voice, is displayed on one regionof the display 151. When the wearer applies the proximity touch to thecorresponding icon 840, the content information to be next presented isoutput as the wearer's already-recorded voice,

Referring to FIGS. 9A and 9B, examples are described below in each ofwhich the screen output to the display device is controlled based on thewearer's voice command. When a predetermined voice command is appliedthrough the microphone 122 when the following content information andthe additional information are output to the display 151, the controller180 controls the display 151 so that the display change that correspondsto the voice command input is displayed.

Further, the predetermined voice command is a command already registeredwith the display device 100. For example, when a voice (for example,“page five,” “first page”) referring to a specific page, or a voice (forexample, “next page”) referring to the moving direction of the pagecurrently output, an operation corresponding to the corresponding voicecommand is performed.

For example, as illustrated in FIG. 9A, when the wearer says “next” whenthe screen corresponding to the following content information is outputto the display 151, the controller 180 recognizes this as a controlcommand for displaying the following page. Accordingly, a screen 901 ofa page 3 is changed to a screen 903 of a page 4.

In addition, for example, as illustrated in FIG. 9B, the wearer says“beginning” when a screen 903 of a page 9 corresponding to the followingcontent information is output to the display 151, the controller 180recognizes this a control command for displaying the beginning page ofthe presentation. Accordingly, a screen 903 of a page 9 is changed to ascreen 904 of a page 1 in the display 151. In addition, the screenchanges corresponding to those as illustrated in FIGS. 9A and 9B areperformed on the screen 80 at the same time.

In addition, the controller 180 is set so as to operate in response toonly the wearer's voice command. To do this, the controller 180 comparesthe voice command, input through the microphone 122, with thealready-recorded wearer's voice to determine whether or not there isconsistency between them.

Further, occasionally during the progress in the presentation, thewearer spends a lot of time talking about a subject that does not relatedirectly to the presentation. In this instance, the display device 100needs to guide the wearer to talking about a subject that relates to thepresentation.

To do this, if the voice information input through the microphone 122remains unmatched to the already-stored content details for apredetermined time or more, the controller 180 outputs a predeterminedalarm. Further, the predetermined alarm includes at least one or moreamong a sound, a message, a vibration, and a highlighting effect for thefollowing content information (a highlighting effect for an imagerepresenting the time information).

As the voice information is unmatched to the details of thealready-stored content remains for a longer time, strength of the alarmis greater. In addition, the screen change in the display 151 and/or thescreen 80, described above, is performed with the successive multipleinputs by the wearer.

For example, if the image projected onto the screen 80 is to be changedwithout having to operate the projector 50, the touch gesture, the starechange, or the like is performed on the image display device 100 formoving to the page corresponding to the desired content information, andthen the screen output to the display 151 through the gesture inputillustrated in FIG. 7B is provided to the screen 80.

Examples are described below in each of which the display device 100described in the present invention is connected to the externalapparatus 70 that provides the video information to the projector 50 oris connected to a different display device 100 in order to control thescreen output to the display 151 or to control the operation of thedisplay device 100.

In the examples illustrated in FIGS. 10A to 10C, the display device 100according to the embodiment of the present invention is connected to theexternal apparatus 70 or the different display device 100 in order toreceive questions associated with the presentation and conduct a searchfor the purpose of preparing for answering the questions.

In addition, a wireless or cable connection is made between the displaydevice 100 and the external apparatus 70 and between an externalapparatus 170 and the projector 50, for example, using a short-rangecommunication standard, a wireless Internet standard such as Wi-Fi, oran external-apparatus interface standard such as a universal serial bus(USB).

In addition, if the connection is made between the display device 100and the external apparatus 70, the display device 100 outputs the screeninformation, the same as the image to be projected onto the screen 80through the projector 50, or outputs the screen information includingthe information more detailed than the screen-projected image. To do so,the display device 100 receives the data relating to the correspondingscreen information from the external apparatus 70.

To do this, the display device 100 further includes a wirelesscommunication unit for receiving a wireless signal corresponding to theinformation relating to the presentation described above, which isconnected to the external apparatus 70 or the different display device.

When the wireless signal is received from the external apparatus 70 orthe different display device connected, the controller 180 converts thewireless signal into characters and the characters that results from theconversion are displayed on one region of the display 151. In addition,the controller 180 stores the characters that results from theconversion, in the document file format in which the characters aretransmittable to the outside.

In addition, the display device 100 described in the present inventioncan transmit at least an item of data to the external apparatus 70 orthe different display device connected through the wirelesscommunication unit .

In this instance, the controller 180 searches for the content detailsassociated with the already-stored presentation using the charactersthat result from the conversion, as keywords. The data corresponding tothe result of the search is displayed on the display 151 or istransmitted to the connected external apparatus 70 and thus the feedbackcan be performed on the data.

For example, as illustrated in FIG. 10A, the display device 100 receivesthe video information from the connected external apparatus 70 andprovides or outputs the received video information to the screen 80 orto the display 151. In addition, as illustrated in FIG. 10A, the displaydevice 100 worn by the presenter a display device 100 b worn by thelistener who listens to the presentation are connected to each other forinteraction between them.

In this instance, as illustrated in FIG. 10B, when a question input intothe display device 100 b worn by the listener is received by the displaydevice 100 of the wearer, questions corresponding to a script Acorresponding to the following content information are output to oneregion B of the display 151. Order in which the questions are displayedcorresponds to the time when the question arrives from the displaydevice 100 b worn by the listener. In addition, although the screensthat are output to the display device 100 b worn by the listener and thedisplay device 100 by the wearer are different from each other, thecharacters corresponding to the question are displayed on a scriptposition corresponding to a page into which the listener inputs thequestion.

FIG. 10C illustrated a response screen that the display device 100transmits to the display device 100 b worn by the listener. The displaydevice 100 searches for the content details (which can includemore-detailed additional information) associated with the already-storedpresentation using the characters corresponding to the question as thesearch key words. Results 1010 and 1020 of the search are transmitted tothe display device of the listener who transmits the question, and thusthe answer to the question is provided without interrupting thepresentation in progress. When the answer is not satisfactory, thelistener can transmit another question to the display device 100.

In addition, the display device 100 described in the present inventioncollects information relating to the extent to which the listenersunderstand the presentation, through the cameras provided in the displaydevices worn by the listeners and displays the portion of thepresentation, whose a understandability level is below a referencevalue, on the display 151.

Next, FIG. 11 is a diagram illustrating the display device 100 providesthe information relating to the presentation to the wearer and at thesame time, provides the video information to be projected, to theprojector 50. Here, the example in which the display units (that is, thefirst display and the second display) of the display device 100 areprovided for the wearer's left and right eyes, respectively, isdescribed above, but the present invention is not limited to the exampledescribed above.

In addition, the display device 100 can transmit and receives apredetermined wireless signal to and from the projector 50. When thefollowing content information and the additional information that aredescribed above are output to the display 151 of the display device 100,the controller 180 detects a predetermined gesture input fortransmitting the already-stored content associated with the presentationto the projector 50.

As illustrated in FIG. 11, such a gesture is, for example, a gestureinput in which the finger points to the projector 50 when the multiplepoints of the frame of the display 151 are touched on. When such agesture input is detected, the controller 180 controls the projector 50so that the screen displayed on the display 151 is output to the screen80 at the same time. Specifically, as illustrated in FIG. 11, when thegesture input in which the finger points to the projector 50 when themultiple points of the frame of the second display (the left-sidedisplay) are touched on, a screen 1110 output to the second display isprojected onto the screen 80 through the projector 50.

Conversely, when the gesture input in which the finger points to theprojector 50 when the wearer touches on the multiple points of the frameof the first display (the right-side display), the screen output to thefirst display is displayed on the screen 80 through the projector 50.

If the same image is output to the display 151 and the screen 80 in thismanner, when the screen output to the display 151 is changed untilbefore a different gesture input by the wearer (for example, a gestureinput that draws a shape “X” facing the projector 50) is detected, thescreen output to the screen 80 is accordingly changed.

As described above, in the display device according to the embodiment ofthe present invention, and the method of controlling the display device,the related information is provided so that the presenter of thepresentation proceeds with the presentation smoothly, with the displaydevice being mounted on the head or other portions of the wearer. Thisprovides the presenter with convenience because a user operation forcontrolling is simple. In addition, although an event happensunexpectedly, such as when the presenter is in the tense state, or whenthe presenter forgets the details of the presentation, the relatedinformation is provided so that the presentation proceeds without anyinterruption. This helps the presenter proceed with the presentation ina convenient manner.

In addition, the information relating to the presentation, transferredfrom the different external apparatus is provided in the formrecognizable to the presenter, or the feedback on the information isgenerated and is transferred to the external apparatus, the interactionis immediately and quickly between the presenter of the presentation andthe listener.

The foregoing embodiments and advantages are merely exemplary and arenot to be considered as limiting the present invention. The presentteachings can be readily applied to other types of apparatuses. Thisdescription is intended to be illustrative, and not to limit the scopeof the claims. Many alternatives, modifications, and variations will beapparent to those skilled in the art. The features, structures, methods,and other characteristics of the exemplary embodiments described hereinmay be combined in various ways to obtain additional and/or alternativeexemplary embodiments.

As the present features may be embodied in several forms withoutdeparting from the characteristics thereof, it should also be understoodthat the above-described embodiments are not limited by any of thedetails of the foregoing description, unless otherwise specified, butrather should be considered broadly within its scope as defined in theappended claims, and therefore all changes and modifications that fallwithin the metes and bounds of the claims, or equivalents of such metesand bounds are therefore intended to be embraced by the appended claims.

What is claimed is:
 1. A wearable electronic device, comprising: awireless communication unit configured to be wirelessly connected to aprojector for projecting a stored presentation onto a screen of anexternal device; a main body configured to be worn by a user; amicrophone integrally connected to the main body; a sensing unitconfigured to detect a bio state of the user wearing the electronicdevice; a display unit configured to be attached to the main body; and acontroller configured to: match a voice information input through themicrophone with a portion of the stored presentation, and display a partof the stored presentation that follows the portion of the storedpresentation matching the voice information input on the display unit,wherein the controller is further configured to change an output size ofthe part of the stored presentation that follows the portion of thestored presentation or highlight the part of the stored presentationthat follows the portion of the stored presentation when the bio stateindicates the user to be in a tense state.
 2. The electronic device ofclaim 1, wherein the controller is further configured to: convert thevoice information into text, and search the stored presentation for theconverted text so as to match the voice information with the portion ofthe stored presentation.
 3. The electronic device of claim 2, whereinthe controller is further configured to: display the converted text onthe display unit with a different highlighting effect to distinguish thedisplayed converted text from the part of the stored presentation thatfollows the portion of the stored presentation.
 4. The electronic deviceof claim 1, wherein the display unit includes first and second displayregions for first and second eyes of the user.
 5. The electronic deviceof claim 4, wherein the controller is further configured to: display, onthe first display region, the part of the stored presentation, anddisplay, on the second display region, at least a portion of a sameimage as an image of the presentation projected onto the screen.
 6. Theelectronic device of claim 5, wherein the controller is furtherconfigured to display a progress indicator on the second display regionindicating a progress state of the presentation based on the imageprojected onto the screen.
 7. The electronic device of claim 5, whereinthe presentation is stored in multiple pages of content, and wherein thecontroller is further configured to: display, on the second displayregion, the multiple pages of content as overlapping and with a pagecurrently being projected on the screen of the external device beingdisplayed first among the multiple pages.
 8. The electronic device ofclaim 7, wherein the controller is further configured to display a pageoption on the display unit that can be touched or proximity touched toturn pages of the multiple pages.
 9. The electronic device of claim 4,wherein the controller is further configured to: display the portion ofthe stored presentation on the first display region, search foradditional information about the displayed portion of the storedpresentation, and display the additional information on the seconddisplay region.
 10. The electronic device of claim 1, wherein thecontroller is further configured to: convert the part of the storedpresentation into a voice signal, output the voice signal to an ear ofthe user, and adjust an output speed of the voice signal to correspondto an input speed of the voice information.
 11. The electronic device ofclaim 1, wherein the controller is further configured to highlight thepart of the stored presentation when the detected bio state indicatesthe user is in the tense state.
 12. The electronic device of claim 1,further comprising: at least one camera on the main body and configuredto detect a gesture input by the user.
 13. The electronic device ofclaim 12, wherein the controller is further configured to project animage output to the display unit onto the screen of the external device,when the detected gesture input includes the user waving their handbetween the main body and the screen when the main body and the screenface each other.
 14. The electronic device of claim 12, wherein thecontroller is further configured to magnify the part of the storedpresentation displayed on the display unit when the detected gestureinput includes a rotating hand gesture in a first direction, and reducethe part of the stored presentation displayed on the display unit whenthe detected gesture input includes a rotating hand gesture in a seconddirection opposite to the first direction.
 15. The electronic device ofclaim 12, wherein the controller is further configured to scroll throughlines of the part of the stored presentation displayed on the displayunit in a direction corresponding to a direction of a touch and dragapplied to a region of the main body including a touch sensor.
 16. Theelectronic device of claim 12, wherein the controller is furtherconfigured to forward page through pages of the part of the storedpresentation based on a tapping touch input on a first region of themain body, and reverse page through pages of the part of the storedpresentation based on a tapping touch input on a second region of themain body.
 17. The electronic device of claim 4, further comprising: atleast one camera on the main body and configured to track an eyemovement of the user, wherein when the detected eye movement is fixed toa specific object output to the first display region, the controller isfurther configured to perform a search associated with the specificobject and display results of the search on the second display region.18. The electronic device of claim 1, wherein the controller is furtherconfigured to match the voice information input through the microphonewith preset voice commands, and when the voice information matches apreset voice command, execute the preset voice command.
 19. Theelectronic device of claim 1, wherein the wireless communication unit isfurther configured to receive a wireless signal corresponding toinformation relating to the presentation from an external apparatus, andwherein the controller is further configured to convert the wirelesssignal into characters, and display the characters on a region of thedisplay unit or store the characters in a document file format in whichthe characters are externally transmittable.
 20. A method of controllinga wearable electronic device including a main body configured to be wornby a user, the method comprising: wirelessly connecting, via a wirelesscommunication unit, to a projector for projecting a stored presentationonto a screen of an external device; matching, via a controller, a voiceinformation input through a microphone integrally connected with themain body with a portion of the stored presentation; and displaying, viaa display unit, a part of the stored presentation that follows theportion of the stored presentation which matches the voice informationinput on the display unit, wherein the method further comprises changingan output size of the part of the stored presentation that follows theportion of the stored presentation or highlighting the part of thestored presentation that follows the portion of the stored presentationwhen the bio date indicates the user to be in a tense state.